activ learn direct explor complex system physic base simul code wide scienc engin model complex system infeas studi code provid highest fidel represent system behavior slow run insight system limit conduct exhaust sweep dimension input paramet space step dimens requir kd simul trial translat kd cpu dai current simul altern direct explor simul trial cleverli chosen step result previou trial supervis learn techniqu svm kde gp appli build simplifi predict model system behavior model activ learn framework identifi valuabl trial run activ learn strategi examin includ recent propos inform theoret approach perform evalu set thirteen synthet oracl serv surrog expens simul enabl experi replic research activ learn irrelev exampl abstract activ learn algorithm attempt acceler learn process request label inform item real world problem exist unlabel item irrelev user classif goal queri point slow learn provid inform problem interest observ irrelev item present activ learn perform wors random select requir time queri achiev level accuraci propos approach relev bia activ learner combin default select heurist output simultan train relev classifi favor item inform relev experi real world problem benchmark dataset relev bia approach significantli improv learn rate activ learn approach learn detect small impact crater autom knowledg discoveri simul paper explor aspect knowledg discoveri simul landscap character problem aim identifi region input paramet model space lead output behavior larg scale numer simul widespread scientist engin rang govern agenc academia industri case simul provid mean examin process infeas imposs studi cost simul studi high term time comput resourc requir conduct trial manpow need sift result output strong motiv develop autom method enabl effici knowledg extract unlik tradit data mine knowledg discoveri simul limit static pre determin dataset simul oracl gener data choos exploit opportun emploi activ learn support vector machin svm choos valuabl simul trial run realworld scientif simul asteroid collis magnetospher model demonstr twofold sixfold reduct number simul trial requir achiev level fidel landscap character compar standard grid base sampl approach learn detect small impact crater mine patter activ video data techsat autonom space scienc agent as jpl nasa gov diamond ey imag mine system distort dinvari recognit jitter queri paper present approach achiev distort invari recognit classif test classifi view queri intend find similar exampl train set class model deriv train set kei idea queri singl pattern construct robust queri base famili pattern form distort test queri execut slower invari successfulli pre compil train signific advantag context provid invari memori base learn ii model select reduc train time expens test time desir trade iii enabl robust ad hoc search base singl preliminari test memori base learn nist handwritten digit databas limit set shear translat distort produc error rate diamond ey imag mine system hierarch shape model spot keyword cursiv handwrit data instanc handwritten word consist basic featur hump cusp cross arrang deform spatial pattern keyword cursiv text detect featur correct spatial configur keyword model hierarch set word fragment consist lowerlevel featur flexibl spatial configur keypoint fragment model dryden mardia dm probabl densiti shape configur writer depend test transcript declar independ word charact method detect eleven instanc keyword govern fals posit introduct handwrit offer natur human comput interfac tradit keyboard keyboard frustrat children novic user possess limit type skill advanc probablist affin invari recognit probabilist approach object recognit local photometri global geometri object class includ human face model set characterist part arrang variabl spatial configur introduc simplifi model deform object class deriv optim detector model optim detector realiz special circumst independ part posit cousin optim detector develop soft part detector probabilist descript spatial arrang part spatial arrang model probabilist shape statist achiev invari translat rotat scale improv recognit perform method base hard part detector demonstr problem face detect clutter scene introduct visual recognit object chair sneaker face cup car challeng problem comput vision artifici intellig histor learn recogn volcano venu dramat improv sensor imag acquisit technolog creat demand autom tool aid analysi larg imag databas describ develop jartool trainabl softwar system learn recogn volcano larg data set venusian imageri machin learn approach easier geologist identifi exampl volcano imageri domain knowledg set pixellevel constraint approach provid portabl domain explicit reprogram user simpli suppli system set train exampl show develop system requir complet set skill requir appli machin learn toi world domain paper discuss import aspect applic process commonli encount toi world includ obtain label train recognit planar object class present framework recogn planar object class base local featur detector probabilist model spatial arrang featur allow object deform repres shape statist learn exampl instanc object imag detect find featur correct spatial configur algorithm robust respect partial occlus detector fals alarm miss featur success rate achiev problem locat quasi frontal view face clutter scene introduct earli pattern recognit algorithm base templat match optim detect signal white nois underli assumpt signal rare hold true consider effort devot extend method handl variabl target signal approach find face clutter scene label random graph match effici alloc resourc hypothesi evalu statist approach autom analysi radar imageri venu handl lack ground truth knowledg discoveri larg imag databas deal uncertainti ground truth paper discuss problem knowledg discoveri imag databas focu issu aris absolut ground truth case user explor larg databas search item easi defin complet circumv problem user exampl item interest specif item inconsist multipl label singl time label paper discuss issu aris term elicit subject probabilist opinion estim basic paramet interest probabilist label learn probabilist label effect evalu user algorithm perform absenc ground truth problem search imag data set order automat locat catalog small volcano planet venu case studi infer ground truth subject label venu imag 